A DC Programming Approach for Sparse Eigenvalue Problem
نویسندگان
چکیده
We investigate the sparse eigenvalue problem which arises in various fields such as machine learning and statistics. Unlike standard approaches relying on approximation of the l0norm, we work with an equivalent reformulation of the problem at hand as a DC program. Our starting point is the eigenvalue problem to which a constraint for sparsity requirement is added. The obtained problem is first formulated as a mixed integer program, and exact penalty techniques are used to equivalently transform the resulting problem into a DC program, whose solution is assumed by a customized DCA. Computational results for sparse principal component analysis are reported, which show the usefulness of our approach that compares favourably with some related standard methods using approximation of the l0-norm.
منابع مشابه
A D.C. Programming Approach to the Sparse Generalized Eigenvalue Problem
In this paper, we consider the sparse eigenvalue problem wherein the goal is to obtain a sparse solution to the generalized eigenvalue problem. We achieve this by constraining the cardinality of the solution to the generalized eigenvalue problem and obtain sparse principal component analysis (PCA), sparse canonical correlation analysis (CCA) and sparse Fisher discriminant analysis (FDA) as spec...
متن کاملDC approximation approaches for sparse optimization
Sparse optimization refers to an optimization problem involving the zero-norm in objective or constraints. In this paper, nonconvex approximation approaches for sparse optimization have been studied with a unifying point of view in DC (Difference of Convex functions) programming framework. Considering a common DC approximation of the zero-norm including all standard sparse inducing penalty func...
متن کاملA DC programming approach for solving the symmetric Eigenvalue Complementarity Problem
In this paper, we investigate a DC (Difference of Convex functions) programming technique for solving large scale Eigenvalue Complementarity Problems (EiCP) with real symmetric matrices. Three equivalent formulations of EiCP are considered. We first reformulate them as DC programs and then using DCA (DC Algorithm) for their solution. Computational results show the robustness, efficiency, and hi...
متن کاملMATHEMATICAL ENGINEERING TECHNICAL REPORTS Eigenvalue Optimization of Structures via Polynomial Semidefinite Programming
This paper presents a sequential semidefinite programming (SDP) approach to maximize the minimal eigenvalue of the generalized eigenvalue problem, in which the two symmetric matrices defining the eigenvalue problem are supposed to be the polynomials in terms of the variables. An important application of this problem is found in the structural optimization which attempts to maximize the minimal ...
متن کاملEfficient DC programming approaches for the asymmetric eigenvalue complementarity problem
In this paper, we propose nonlinear programming formulations (NLP) and DC (Difference of Convex functions) programming approaches for the asymmetric eigenvalue complementarity problem (EiCP). The EiCP has a solution if and only if these NLPs have zero global optimal value. We reformulate the NLPs as DC Programs (DCP) which can be efficiently solved by DCA (DC Algorithm). Some preliminary numeri...
متن کامل